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ABSTRACT 


This  thesis  researches  the  feasibility  of  a  TDA  (tactical  decision  aid)  to  defend  a 
high  value  surface  unit  from  an  enemy  submarine.  Accordingly,  this  research 
adopts  a  FAB  (forward  and  backward)  algorithm  to  search  for  a  moving  target.  It 
develops  a  prototype  of  a  TDA:  FABTDA  which  gives  an  optimal  allocation  for 
search  aircraft. 
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1.  INTRODUCTION 


A.  BACKGROUND 

When  broad  localization  of  a  hostile  submarine  is  given,  a  fleet  commander  who 
commands  a  high  value  surface  unit  (HVU)  faces  the  problem  of  whether  he  should  use 
his  airborne  ASW  (Anti  Submarine  Warfare)  units  in  an  offensive  or  defensive  posture 
against  the  target.  If  the  initial  information  is  accurate  enough,  concentration  of  ASW 
assets  for  killing  the  target  could  be  effective  for  both  defending  the  HVU  as  well  as 
prosecuting  the  target.  Therefore,  it  would  be  logical  if  the  development  of  a  TDA 
(tactical  decision  aid)  included  a  defensive  search  plan  which  minimizes  the  probability 
of  the  HVU  being  killed  by  a  hostile  submarine. 

Washburn  (1983)  showed  that  the  FAB  (Forward  And  Backward)  algorithm  could 
be  applied  to  search  for  a  target  moving  with  a  Markov  process.  Although  he  suggested 
that  the  FAB  algorithm  could  be  applied  to  a  defensive  optimal  search,  there  has  been  no 
application  of  the  FAB  algorithm  for  this  purpose. 


B.  OBJECTIVE 

This  thesis  demonstrates  that  the  FAB  algorithm  is  applicable  to  a  kind  of  tactical 
decision  aid  which  gives  an  optimal  search  plan  to  defend  the  HVU  against  a  hostile 
submarine  moving  with  a  Markov  process.  A  prototype  of  such  a  TDA  using  the  FAB 
algorithm  is  described  below. 
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n.  METHODOLOGY 


A.  GENERAL  SITUATION 

The  problem  is  to  find  an  optimal  search  plan  for  minimizing  the  expected  loss  of 
the  HVU  against  a  hostile  submarine,  based  on  rough  information  on  the  submarine’s 
location  and  direction  of  movement. 

The  assumptions  are  as  follows: 

•  Time  and  space  are  discrete. 

•  A  hostile  submarine  starts  from  an  arbitrary  point  and  moves  with  a  Markov 
process. 

•  A  friendly  HVU  tries  to  transit  the  submarine's  patrol  area. 

•  The  HVU  transits  one  unit  of  length  per  unit  time. 

•  The  submarine  can  use  a  USM  (Undersea  to  Surface  Missile)  to  kill  the  HVU 
within  range. 

•  In  addition,  the  submarine  can  use  a  USM  and  a  torpedo  to  kill  the  HVU  when 
within  torpedo  range  (USM  range  is  greater  than  torpedo  range). 

•  The  commander  of  the  HVU  has  a  limited  number  of  ASW  aircraft  to  search  for 
and  attack  the  enemy  submarine. 

•  Each  ASW  aircraft  is  assigned  a  particular  area(cell)  and  searches  for  the  target 
randomly.  If  any  aircraft  detects  the  target,  the  target  is  considered  killed. 

•  At  the  beginning,  the  commander  has  information  on  the  target's  location  with  a 
given  error,  and  information  on  the  target’s  motion  based  on  the  transition  probabilities  of 
a  Markov  process. 
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In  this  situation,  the  commander  must  decide  how  to  search  for  the  target. 


Figure  1 .  shows  these  assumptions. 


Hostile 

SUB 


Figure  1.  An  illustration  of  the  problem. 


B.  PROBLEM  FORMULATION 


Let 


X(t)  =  (x„y.) 


be  a  random  variable  which  represents  the  position  of  the  hostile  submarine  moving  with 
a  Markov  process.  The  initial  distribution  and  transition  probabilities  are  known  to  be 
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Pr{X(f  =  0)  =  (x,y)}  =  pU,>’) 

Pr{Z(/  + 1)  =  (x'  ,y )  I  Xit)  =  ix,y)}  =  nx,y,X,y  ,t) 

Let  n(X,t)  be  the  number  of  ASW  aircraft  assigned  to  each  cell(X)  at  time  t.  These  are  the 
decision  variables.  Let  U(n,X,t)  be  the  probability  that  n  search  assets  fail  to  detect  the 
target  in  cell  X  at  time  t  when  the  target  is  in  the  cell,  and  assume  that 

U{n{x,y,t),x,y,t)  =  exp(-c(x,y,0  •  n(x,y,t)), 

where  c(x,y,t)  is  a  search  coefficient  that  reflects  the  acoustic  conditions  in  the  cell,  the 
sensor  performance,  and  the  sweep  rate  of  search  units.  To  simplify,  assume  that  c(x,y,t) 
is  a  constant  c  and  omit  the  unnecessary  arguments  of  U( ). 

U{niX,t))  =  exp(-c  •  niX,t)) 

From  the  assumption  in  the  previous  section,  the  hostile  submarine  can  use  USMs  and 
torpedoes  to  attack  a  surface  unit.  Let  D(X,t)  be  the  probability  that  the  submarine  at  X  is 
able  to  kill  the  HVU  at  time  t,  given  that  it  decides  to  attack.  Since  R,< 

D(X,0  =  1  -  (1  -  SSKP,)-  (1  -  SSKPJ  :  distancc(Sub.,HVU)  <  R, 

=  SSKP  ■  R,  <  distmceiSub.,  HVU)  <  R„ 

=  0  :  <  distanceiSub.,HVU) 

where  Rt  and  Rm  are  ranges  of  the  torpedo  and  the  USM,  SSKP ,  and  SSKP„  are  the  single 
shot  kill  probabilities  of  the  torpedo  and  the  missile. 

Let  Y(t)  be  the  probability  that  the  submarine  will  try  to  attack  the  HVU  at  time  t 

^max 
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Given  that  it  survives,  the  submarine  will  attack  the  HVU  exactly  once.  Let  L(X,t)  be  the 
lethality  defined  as 

L{x,y,t)  =  Y{t)  •  D{x,y,t) 

Since 

Y[U{n{X,t)) 

/•=o 

is  the  probability  that  the  submarine  survives  to  at  least  time  t,  the  probability  that  the 
HVU  is  attacked  is 


H{n{  ))  =  £ 


The  searcher’s  problem  is  therefore 

Min  [H(n( ))] 

n(  ) 

S/T  ^n(x,y,t)<  N^ircraft  for  allt 
n(ac,y,r)  integers  >0 


C.  FAB  ALGORITHM 

Washburn  [1]  shows  that  H(n( ))  can  be  represented  as 


H(n(  ))  =  A(t)  +  X  P(X,  t)  •  Uin(X,  t))  ■  F(X,  t)  for  all  t, 


(1) 


where 


A(t)  =  E 


1-1 


'^L(X,t)Ylu{niX,t)) 

1=0  r=o 


In  addition,  the  forward  function  P( )  and  the  backward  function  F(  )  are  defined  as 
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follows: 


^P{x,  y,t  =  0)  =  p(x,  y)  for  dl  x,  y 

Pix,y,t  +  1)  =  j^nx,y,x\y  ,t)  ■  U{n{^  ,y' ,t))  ■  P(x' ,y'  ,t) 

x\y' 

^  forallj:,>',0<r<r„„ 

mx,y,t^  t^J  =  L(x,y,t^J  for  all  x,}; 

F(x,y,t)  =  L(x,y,t)  +  ‘  + 1) 

x’,y 

forallx,}',0<f 

Now,  assume  that 

nit)  =  n’  (0  for  any  r  9^  to- 

Then, 


(2) 

(3) 

(4) 


Mini  )) -  Hin'  ( ))  =  ^Pix,y,to)  •  {Uinix,y,to))  -  Uin'  (x,y,to))}  •  F(x,y,to). 

(5) 


(5)  is  true  because  from  (l)-(4),  A(x,y,t),  P(x,y,t)  and  F(x,y,t)  don’t  depend  on  n(to)  and 
n'(to).  If  n(  )  exists  such  that  H(n'(  ))>  H(n( ))  for  all  n  Y  )  satisfying  (4),  this  n(  )  is 
“critical.”  In  addition,  an  allocation  n( )  is  optimal  if  HfnY  ))>H(n( ))  for  all  feasible  n'( ). 
Criticality  is  necessary  but  not  sufficient  for  optimality. 

The  main  idea  of  the  FAB  algorithm  is  as  follows: 

If  n(  )  is  not  critical,  (4)  and  (5)  guarantee  that  an  allocation  n’(  )  can  be  found  which 
satisfies  H(n(  ))>  H(n’( )).  After  solving  the  minimizing  problem 


Min^PiX,t)Uin'  iX,t))FiX,t), 


the  FAB  algorithm  replaces  n( )  with  n’( ),  calculates  P( )  and  F( )  based  on  n’( ),  and 
repeats  this  process  until  H( )  can’t  be  reduced. 
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In  pseudocode.  The  FAB  algorithm  is: 


*function  update _allocation{Pix,  y,  t),  F(x,  y,  t)) 
begin 

Min  2^  P(x,  y,t)  U (mix,  y,  t))  ■  F(x,  y,  t) 

x,y 

m{x,y,t) 'mXcgtx  >0 
update jallocation  <-  m( ) 
return 

*end  function 

♦procedure  FAB(p(a:, y), F (j:' ,y  ,x, y, t),  L(x, y, t)) 
begin 

set  n()  =  0  for  all  x,y,  t 

calculate  F(x,y,t)  with  n( )  all  /  using(3) 

P(x,y,0)  =  InitialDistribution(x,y) 

Do 

H,  =  H, 

calculate  F(ji:,y,r)  with  n()  all?  using(3) 

fort  =  0tot^^ 

n(,t)<r-  update_allocation(P(x,y,t),F(x,y,ty) 
calculate  P(jc,  y,  t  + 1)  with  n( ,  t)  using(2) 

next  t 

H,  =  YP(x,y,0)  •  U(n(x,yM  ■  Fix,y,0) 

Loop  until  = 
output  n( ),  Hq 
end  procedure 

Since  the  FAB  algorithm  starts  by  setting  n(  )=0,  the  first  iteration  produces  an  allocation 
that  would  be  optimal  if  no  searching  were  performed  in  the  future.  Such  an  allocation  is 
called  “myopic"  and  is  of  some  interest  in  itself.  In  many  cases,  the  myopic  plan  is  nearly 
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optimal. 


D.  DYNAMIC  PROGRAMMING 

In  the  FAB  algorithm,  it  is  necessary  to  solve  the  nonlinear  integer  minimizing 
problem  in  the  function  update _allocation( ).  For  this  purpose,  this  research  uses  a 
dynamic  programming  procedure.  By  translating  discrete  x-y  coordinates  to  the  sequence 
0  to  (NxNy-1)  like  Figure  2.,  the  problem  can  be  restated  as  a  1-dimensional  distribution 
problem. 


0 

1 

2 

3 

... 

Nx-2 

Nx-1 

NX 

Nx+1 

Nx-f2 

... 

2Nx 

2NX+1 

... 

hTij 

Nx  (Ny 

•1) 

1 _ 

Nx  Ny-1 

_ I 

Figure  2. 1 -dimensional  indices  for  x-y  coordinates. 


x  =  i  Tnod(N^y> 
y  =  idWN^  ; 


=  N^+x 
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for  all  t 


(  ( 


min 

«0‘.0 


m) =J,pu,mn(j,twu,t) 

\  J 


SIT 

N,Ny-l 

'£nU,t)  < 

j=0 

(^n(i,0  integers  >0 
In  recursive  form,  this  problem  is 


f  hJN)  =  min [P(0,t)U(n)F{0,t)] 

0<n<N^ 

for;  =  l-iV,iV^-l 

hjiN)=  min  \hj_,im)  +  P(lt)Uin)F(j,t)\ 
min(^^)  = 

^A^,n,/n  integers  >0 

Figure  3.  illustrates  how  to  solve  this  type  of  a  minimizing  problem  using  dynamic 

programming.  (Sugiyama  (1976)). 
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Figure  3.  Minimizing  the  recursive  form  in  dynamic  programming.  (Sugiyama  (1976)) 

E.  A  TWO  SIDED  GAME  VALUE 

A  procedure  to  find  the  optimal  allocation  to  protect  the  HVU  from  a  hostile 
submarine  has  been  described.  However,  this  formulation  includes  a  given  Y(t)  which 
represents  the  probability  that  the  submarine  tries  to  attack  the  HVU  at  time  t.  To  clarify 
the  dependence  of  Hon  Y( ),  use  explicit  notation  H( )  =  H(n(  ),Y())  below.  In  the  actual 
situation,  the  HVU  commander  can't  know  the  submarine’s  intention,  but  the  commander 
can  assume  that  the  submarine  will  maximize  its  chance  to  kill  the  HVU.  Therefore,  this 
situation  is  described  as  a  two  sided  game.  It  follows  that: 
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The  HVU  commander  controls  n(x,y,t)  as  decision  variables  to  minimize 


H(n(),Y()). 

•  The  submarine  controls  Y(t)  as  decision  variables  to  maximize  H(n(  ),Y( )). 

The  game  value  v  is  in  the  interval 

Max  Min[H{ni ),  Y( ))]  <  v  <  Min  Max[H{n( ),  Yi ))] . 

Y  n  n  Y 

If  n^( )  is  the  allocation  returned  by  FAB,  let 

))^E  DiX,t)f[U(n,iX,r)) 

f=0 

Since 

^max 

mn,(  ),Y())  =  2Y(t)f,(n,()), 

MaxlH(n,(  ),Y( ))]  <  Maxf,(n,( )) . 

Therefore,  the  value  Maxft(n^(  is  an  upper  bound  on  v. 

To  find  the  a  lower  bound  on  v,  define  G(Y)  as 

G(Y)^Min[H(ni),Y())]. 

n 

To  simplify  the  exposition,  assume  for  the  moment  that  G(Y)  is  the  objective  function 
returned  by  the  FAB  algorithm;  that  is,  assume  FAB  returns  a  global  minimum.  Since 
G(Y)  <  V  for  every  Y,  any  submarine  strategy  Y  has  an  associated  lower  bound  G(Y).  To 
find  good  lower  bound,  Y  must  be  chosen  to  make  G(Y)  large.  Maximizing  G(Y)  is 
difficult,  but  still  a  good  value  for  Y  (call  it  Y^ )  can  be  found  using  the  following 
“greedy“  algorithm  where 


12 


is  increased  gradually  from  0  to  1  with  step  AY.  In  each  step,  add  AY  to  Y{t)  which  gives 
largest  increment: 


Ato  Min[H{n{ ),  r(0),  r(l),„  Y{t  - 1),  7(0  +  A7,  Y{t  + 1),„  7(rmax))]  . 


In  pseudocode,  the  greedy  algorithm  is: 


*procedure  find_sub_strategy 
begin 

Ho=0 

Do  while  Y,^,„i  <  1 
forr  =  0tor,„^ 
y.ore  ^  Yit) 

7(0<-7(0  +  A7 

call  procedure  FAB(p(x,y),  r(j:’  ,y  ,x,y,t),  7(0  •  D(x,y,t)) 
i{H>HQ  then 

to 

end  if 


next  t 

7(/o)<-m)  +  A7 

Y,o,al  +  ^Y 

Loop 

output  Yi),H 
end  procedure 


There  is  good  reason  to  expect  7*  to  be  nearly  optimal.  First,  G(Y)  is  a 
concave  function  because 
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G{aY,  +  {\-a)Y^)  =  Min 


*ma3t  *max 

« •  Z  +  (1  r  «)  •  £  Yi.t)  ■  f,in(X,t)) 


t=0 


/=0 


>  a  •  Mini 


J^Y(t)fMX,t)) 


t=0 


+  (1  -  a)  •  Min\ 


‘max 

Y^Y{t)f,(n{X,t)) 


r=0 


=  aG(Y,)  +  (l-a)G(Y^)  for0<a<l 


Second,  if  G(Y)  were  separable  as 

^max 

G(F)  =  £G,(r(0), 

r=0 

the  greedy  algorithm  would  find  the  Maxy  G(Y).  Although  G(Y)  is  not  separable,  at  least 


N(n(  ),Y( ))  is  separable,  so  there  is  good  reason  to  expect  Y^  to  be  nearly  optimal.  A 
lower  bound  is  obtained  in  any  case.  Some  numerical  examples  will  be  given  in  chapter 
J  .  In  practice  the  lower  bound  may  be  in  error  to  the  extent  that  the  value  returned  by 
the  FAB  algorithm  is  not  a  true  minimum. 


F.  IMPLEMENTATION 

The  prototype  FABTDA  is  a  Microsoft  Windows  application  written  in  Visual 
Basic  ver.  3.0.  FABTDA  has  the  following  functions: 

•  FABTDA  finds  the  optimal  allocation  plan  of  ASW  assets  for  a  given  Y(t)  with 
the  FAB  algorithm. 

•  FABTDA  finds  a  myopic  allocation  plan  of  ASW  assets  for  a  given  Y(t). 

•  FABTDA  finds  a  submarine  strategy  which  gives  the  lower  bound  on  the  game 

value. 

•  FABTDA  finds  an  upper  bound  on  the  game  value. 

•  FABTDA  finds  an  optimal  offensive  search  plan,  where  the  word  “offensive” 
means  that  the  search  minimizes  the  probability  that  the  submarine  survives  until  the  last 
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period  without  regard  to  the  fate  of  the  HVU.  The  offensive  search  plan  can  be  calculated 
based  on  D(x.y,t)=l  and  Y(t)  =1  if  t=t^^ ,  Y(t)  =0  if  t<t^.  FABTDA  also  shows  the 
corresponding  probability  that  the  HVU  is  attacked  based  on  the  offensive  search  plan. 

Figure  4  illustrates  the  relationship  of  the  procedures,  inputs  and  outputs  of  FABTDA. 


Input 


SUB  data 

initial  distribution  — 

1  ransiuon  proDaDiiii.y  — “ 

Weapon  range  &  obKr  — 
Attack  probability  — 

HVU  data 

Number  of  search  units  — 

Search  coefficient  — 

Output 

T 

T 

Optimal  allocation 

^  .  . 

FAB 

Find_SUB_Strategy 

&  Prb.lHVU  sunk} 

Figure  4  Outline  of  the  prototype  TDA:  FABTDA. 


Figures  5  through  9  show  data  input  and  output  forms  of  FABTDA.  The  data  can  be 
changed  by  mouse  on  these  input  forms.  All  data  can  be  stored  to  or  loaded  from  a  file  by 
selecting  the  menu  “file.“  If  the  user  clicks  a  command  button,  corresponding  values  are 
sent  from  the  input  form  to  the  variable  in  the  program.  Then  the  caption  of  the  command 
button  “data  set“  is  changed  into  “set  done.“ 
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Figure  5.  FABTDA  input  form  for  initial  distribution  and  transition  probability. 


FAB  TDA 


File  DataSet  Optimizing 


'Enemy”^  Weapons  and  Attack  time' 


Short  Range 
Range  1 
KillProb.  SOX 

Long  Range 
Range  2 
KillProb.  20X 


Attack  Prob.=  .1 
at  8_th  period 


Set  done 
lethality  at  t=  6 


.06 

.06 

.18 

.06 

.18 

.18 

.18 

.06 

.18 

.06 

.06 
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Figure  7.  FABTDA  input  form  for  number  of  ASW  assets  and  their  search  capability. 


Figure  8.  FABTDA  with  the  defensive  option  being  selected. 
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Figure  9.  FABTDA  output  form  for  an  optimal  allocation  by  the  FAB  algorithm. 


The  allocation  of  search  units  at  time  t  is  indicated  on  the  grid.  Moving  the  scroll  bar 
changes  the  value  of  t.  The  symbol  shows  the  position  of  the  UVU. 
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in.  NUMERICAL  EXAMPLES 


A.  VERIFICATION 

To  verify  FABTDA,  consider  a  simple  example  which  can  be  solved  analytically. 
For  this  purpose,  use  the  following  assumptions: 

•  Time  periods  are  zero  to  eight. 

•  The  submarine  is  a  stationary  target,  and  may  be  in  one  of  5  cells:  datum  center 
and  its  nearest  4  cells. 

•  The  submarine’s  weapon  range  is  infinity,  and  its  SSKP=1 . 

•  The  submarine’s  attack  intention  Y(t)  =1  if  t=8,  Y(t)  =0  if  t^^S. 

•  The  HVU  has  5  ASW  assets,  and  each  has  a  0.2  search  coefficient. 

Obviously,  the  optimal  allocation  is  to  assign  one  ASW  unit  in  each  of  5  cells,  and  the 
minimum  objective  function  value  should  be 

Min{H)  =  5  X  -  X  «  0.1653  . 

»  5 

The  output  of  FABTDA  is  as  expected. 

B.  ACTUAL  EXAMPLE 

The  next  example  deals  with  a  more  realistic  situation.  The  realistic  assumptions 
are  as  follows: 

•  Space  is  discrete  with  a  9  by  9  grid,  and  the  cell  size  is  15nm  x  15nm. 
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•  Time  is  also  discrete  running  from  0  to  9  in  one  hour  periods. 


•  The  HVU  transits  at  15kt,  moving  a  single  cell  in  each  period. 

•  The  hostile  submarine  patrols  the  area  with  following  transition  probability, 

A,=-l,  0,  1 

Pr{X(/  + 1)  =  U  +  +  Ap  I  X(t)  =  (x,y)}  = 

On  the  boundary,  the  submarine  turns  back  to  the  inside. 

•  Initially,  the  HVU  has  information  that  the  submarine  is  45nm  ahead  and  45nm 
starboard  with  a  30nm  error  (see  initial  distribution  below). 

•  The  submarine  has  torpedoes  with  a  15nm  range  and  a  70%  SSKP  and  also  has 
USMs  with  a  45nm  range  and  a  20%  SSKP. 

•  The  probabilities  of  submarine  attack  during  each  period  are  0,  0,  0.1,  0.1,  0.2, 
0.2,  0.2, 0.1,  and  0.1. 

•  The  HVU  has  8  ASW  helicopters.  Each  one  can  effectively  sweep  20%  of  the 
15nm  X  15nm  area  in  one  hour. 

Using  these  settings,  FABTDA  gives  the  following  output: 


.UD  .10  .0 

.05  .1  .25 

0  05  05 


A,  =  -l 


0 


This  is  an  outcome  of  FABlTDA. 
by  M.KUNIGAMI 

General  settings 

matrix  size 

(0  to  8)  *  (0  to  8) 
time 

0  to  8 

Initial  enemy  data. 
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/ 


initial  distribution 


y= 

0 

x=  0 

.0 

x=  1 

.0 

x=  2 

.0 

x=  3 

.0 

y= 

1 

.0 

.0 

.0 

.0 

y= 

2 

.0 

.0 

.0 

.0 

y= 

3 

.0 

.0 

.0 

.0 

y= 

4 

.0 

.0 

.0 

.0 

y= 

5 

.0 

.0 

.0 

.083 

y= 

6 

.0 

.0 

.083 

.083 

y= 

7 

.0 

.083 

.083 

.083 

y= 

8 

.0 

.0 

.083 

.083 

X=:  4 

x=  5 

x=  6 

ii 

x= 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.083 

.0 

.0 

.0 

.0 

.083 

.083 

.0 

.0 

.0 

.083 

.0 

.0 

.0 

.0 

transition  probability  to  neighbors 


x=-l 

x=  0 

x=  ; 

y=-l 

.05 

.15 

.3 

y=  0 

.05 

.1 

.25 

y=  1 

.0 

.05 

.05 

weapon  attributions 
short  range  we^>on: 

range  =  1,  SSKP=  .7 
long  range  weapon  : 

range  =  3,  SSKP=  .2 


prob.  that  SUB  trys  to  attack 
t=  0  t=  1  t=  2  t=  3 

p=  .0  .0  .  .1  .1 


t=  4  t=  5 

.2  .2 


t=  6  t=  7  t=  8 

.2  .1  .1 


Search  units  data. 

Nuiriber  of  available  search  units  :  8 
sweep  rate  of  each  unit  :  .2 


Outcome:  allocation  plan  of  search  units  by  FAB 
@s  indicate  position  of  HVU 
Objective  function  value  :H=  .10375 


t=  0 
y=  0 

y=  1 
y=  2 
y=  3 

y=  4 

y=  5 

y=  6 

y=  7 

y=  8 


x=  0 
0 
0 
0 
0 

0  @ 
0 
0 
0 
0 


x=  1  x=  2  x=  3  x=  4  x=  5  x=  6  X 


0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
0  2 
1  0 
0  0 


0  0 
0  0 
0  0 
0  0 
0  0 
2  0 
2  1 
0  0 
0  0 


0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
0  0 


t=  1 

y=  0 
y=  1 
y=  2 

y=  3 

y=  4 


x=  0 
0 
0 
0 
0 
0 


X=:  1  x=  2  x=  3  x=  4  x= 

0  0  0  0  0 

0  0  0  0  0 

0  0  0  0  0 

0  0  0  0  0 

0  @  0  0  0  0 


5  x=  6 
0 
0 
0 
0 
0 


Defensive 


:=  7  x=  8 
0  0 

0  0 

0  0 

0  0 

0  0 

0  0 

0  0 

0  0 

0  0 


:=  7  x=  8 
0  0 

0  0 

0  0 

0  0 

0  0 
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y=5000000000 
y=  6001210000 
y=  70  0  0  2  2  0  0  0  0 

y=8000000000 

t=  2 

x=  0  x=  1  x=  2  x=  3  x=  4  x=  5  x=  6  x=  7  x=  8 
y=0000000000 
y=1000000000 
y=2000000000 
y=3000000000 
y=  40  0  0@0  0  0  0  0  0 

y=5000120000 
y=  6000221000 
y=  7000000000 
y=  8000000000 

t=  3 

x=  0  x=  1  x=  2  x=:  3  x=  4  x=  5  x=  6  x=  7  x=  8 
y=  0000000000 
y=  1000000000 
y=  2000000000 
y=  3000000000 
y=  40  0  0  0@1  0  0  0  0 

y=5000121000 
y=  6000021000 
y=7000000000 
y=8000000000 

t=  4 

x=  0  x=  1  x=  2  x=  3  X-  4  x=:  5  X-  6  x=  7  x=  8 
y=  0000000000 
y-  1000000000 
y=  2000000000 
y=3000000000 
y=40  0  0  0  1@2  0  0  0 

y=5000031100 
y=6000000000 
y=7000000000 
y=  8000000000 

t=  5 

x=  0  x=  1  x=  2  x=  3  x=  4  x=  5  x=  6  x=  7  x=  8 
y=  0000000000 
y=  10  0  0  0  0  0  0  0  0 

y=  2000000000 
y=3000000000 
y=  40  0  0  0  0  1@2  1  0 

y=5000003010 
y=6000000000 
y=  7000000000 
y=8000000000 


x=  0  x=  1  x=  2  x=  3  x=  4  x=  5  x=  6  x=  7  x=  8 

y=  00  0  0  0  0  0  0  0  0 

y=1000000000 
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y=  20  0000  000  0 

y=  30  0000  000  0 

y=  40  0  0  0  0  0  0@4  0 

y=5  0  0000  022  0 

y=  6000000000 

y=7000000000 

y=  8000000000 

t=  7 

x=  0  x=  1  x=  2  x=  3  x=  4  x=  5  x=  6  x=  7  x=  8 

y=0000000000 
y=  10  00000000 

y=  2000000000 

y=  30  0000  002  0 

y=  40  0  0  0  0  0  0  3@0 

y=50  0000  003  0 

y=6000000000 

y=70  0000  000  0 

y=  80  0000  000  0 

t=  8 

x=  0  x=  1  x=  2  x=  3  x=  4  x=  5  x=  6  x=  7  x=  8 

y=0000000000 

y=10  0000  0000 

y=20  0000  000  0 

y=  30  0000  000  1 

y=  40  0  0  0  0  0  0  4  10 

y=  50  0000  0002 

y=  60  0000  000  0 

y=7000000000 

y=  80  0000  000  0 


In  this  example,  the  minimized  defensive  probability  that  the  HVU  is  attack^  is 
0.1038.  The  same  probability  is  0.1145  if  the  HVU  uses  the  offensive  allocation;  the 
increase  shows  the  importance  of  choosing  the  right  objective. 

For  the  myopic  defensive  search,  the  probability  is  0.1052,  and  for  the  myopic 
offensive  search,  the  probability  is  0.1 159. 

Min  H  defensive  offensive 
FAB  0.1038  0.1145 

Myopic  0.1052  0.1159 

The  FAB  algorithm  finds  a  more  effective  search  allocation  than  that  from  the  myopic 
search. 
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In  addition,  FABTDA  can  provide  a  submarine  strategy  by  the  procedure 
find_sub_strategy.  The  procedme  find_sub_strategy  with  AY=0.1  gives  the  following 
probability  that  the  submarine  will  attack  the  HVU  at  t: 

prob.  that  SUB  tries  to  attack 

t=  0  t=  1  t=  2  t=  3  t=  4  t=  5  t=  6  t=  7  t=  8 
p=  .0  .0  ,0  .0  .1  .3  .3  .3  .0 

Using  this  strategy,  FAB  fixes  the  HVU  strategy  to  minimize  the  defensive  objective 
function  value.  In  this  case,  the  objective  function  value  isH  =  0.1133,  an  improvement 
from  the  submarine’s  viewpoint.  This  value  will  be  a  lower  bound  on  the  game  value  as 
long  as  FAB  obtains  a  nearly  optimal  solution. 

Additionally,  FABTDA  provides  an  upper  bound  for  the  game  value.  In  accordance 
with  the  submarine  strategy,  the  upper  bound  of  the  game  value  is 

f,(n())=0.1145. 

Similar  calculation  can  be  performed  for  the  offensive  objective  function. 

In  summary,  the  bounds  are: 

Boixnds  of  game  value  FAB  defensive  FAB  offensive 

Lower  boimd  0.1133  0.1238 

Upper  boiond  0.1145  0.1272. 

The  upper  bound  of  the  defensive  search  is  smaller  than  the  lower  bound  of  the  offensive 
search.  FABTDA  provides  good  bounds  that  can  discriminate  between  defensive  search 
and  offensive  search.  In  this  case,  the  defensive  search  is  worth  considering  to  defend  the 
HVU.  The  best  defense  is  not  always  a  good  offense. 
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IV.  CONCLUSIONS 


FABTDA  demonstrates  that  it  is  feasible  to  develop  a  TDA  to  find  the  optimal 
search  plan  defending  the  HVU  for  a  moving  target  by  using  the  FAB  algorithm.  In 
addition,  the  previous  chapter  shows  that: 

•  The  FAB  algorithm  can  find  more  effective  search  plans  than  the  myopic  search. 

•  FABTDA  can  provide  bounds  on  the  game  value,  which  show  when  the  defensive 
search  is  more  effective  than  the  offensive  search. 

Currently,  FABTDA  uses  a  search  coefficient  that  is  a  constant.  In  the  future,  if 
FABTDA  can  use  space  and  time  dependent  search  coefficients,  more  interesting  allocation 
plans  which  reflect  actual  situations  like  acoustic  conditions  could  be  generated. 
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